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Abstract — We consider the problem of distributed admission 
control without knowledge of the capacity region in single-hop 
wireless networks, for flows that require a pre-specified band- 
width from the network. We present an optimization framework 
that allows us to design a scheduler and resource allocator, and 
by properly choosing a suitable utility function in the resource 
allocator, we prove that existing flows can be served with a pre- 
specified bandwidth, while the link requesting admission can 
determine the largest rate that it can get such that it does not 
interfere with the allocation to the existing flows. 

I. Introduction 

Wireless networks are not only expected to transfer data, 
but also expected to provide multimedia services such as video 
and call conferencing. A common factor of such services is 
that they have Quality of Service (QoS) requirements. In this 
paper, we focus in the case that single-hop flows require a pre- 
specified bandwidth from the network, so we must design an 
algorithm that must determine if there are enough resources to 
fulfill a new request, given that the system is already serving 
a set of flows. 

This is the problem of admission control, and it has been 
extensively studied for wireline networks. However, the case 
of admission control in wireless networks is more challenging, 
since the wireless channel is unreliable and susceptible to 
interference. Hence, the load imposed by a link that requests 
a pre-specified bandwidth from the network not only depends 
of the requested bandwidth, but also of the topology of the 
network due to contention among different transmitting links. 
Therefore, it is not obvious that the techniques developed for 
admission control in wireline networks can be used directly 
in wireless networks. 

Several papers have highlighted the difficulties of guaran- 
teeing QoS requirements in wireless networks. Specifically, JT] 
emphasizes the need to consider load balancing to maximize 
the number of admitted flows, while the importance of taking 
contention into account to determine the available bandwidth 
has been highlighted in 0, 0. The problem is that determin- 
ing the capacity region in wireless networks is not a trivial 
task, and the problem is further complicated if we want to 
implement admission control distributedly. 
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The main contributions of the paper are as follows: 

1) We present an utility maximization framework for re- 
source allocation in single-hop wireless networks that 
allows us to design a distributed solution to the problem 
of admission control. 

2) By introducing a specific utility function, we prove 
that we can induce in the optimization framework an 
assignment of a pre-specified bandwidth to flows already 
admitted, while at the same time figuring out the max- 
imum available bandwidth that can be assigned to the 
new flow. 

3) We present the conditions that the parameters in the util- 
ity function must fulfill to guarantee that the allocation 
in the stochastic system is asymptotically close to the 
desired allocation that has been induced in the static 
optimization framework. 

II. Related Work 

Estimating the available bandwidth to do admission control 
has been an active topic of research. In 0, B, the problem 
of determining the impact of contention to find the available 
bandwidth is studied for multi-hop wireless networks, while 
studies the problem of bandwidth estimation at a node. 
In 0, the problem of contention is taken into account under 
the implicit assumption that the interference and transmission 
range of a node are the same. Some heuristics to support 
QoS are presented in (6), 0, but contention is ignored during 
admission control. 

The use of packet scheduling to guarantee QoS in multi- 
hop networks has been considered in [8|. Some solutions for 
admission control have be implemented centrally 0, ifTOl . or 
assume a specific wireless technology like TDMA [ 1 1 1-[ 13\ or 
CDMA over TDMA lfl4l . fl51 . Using implicit synchronization 
in CSMA/CA networks, a performance similar to TDM is 
achieved in lfl6l . 

Under the assumption that requests can be split, [ 1 1 proposes 
a solution for multi-hop multichannel networks. If the requests 
cannot be split, a heuristic is presented using the least- 
congested, minimum-hop path to route requests. 

The idea of achieving provably good performance without 
any assumptions on the model of the arrival requests was 
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presented in ifTTl , using ideas first developed for wireline 
networks in [18|-[20|. The idea is to study a worst-case model 
to determine the impact of imperfect decisions due to the lack 
of knowledge of future requests. 

To the best of our knowledge, this is the first paper that 
proves that we can accurately estimate the available bandwidth 
during admission control in wireless networks in a distributed 
manner, and without the need to know or estimate the capacity 
region. 

III. System Model 

In this section we introduce the definitions and assumptions 
that we use to model our system. 

We consider a network that is represented by a graph Q = 
{AT, V}, where Af is the set of nodes and T> is the set of 
directional links such that for all n\, G Af, if {n±, 112) G T> 
then node ri\ can transmit to node n%. To identify the links, we 
number them sequentially. Denote by D = \T>\ the number of 
links in the network, and by abusing notation, we sometimes 
use I G T> to mean I e {1,2, ... , D}. 

Consider that time is slotted, and assume for simplicity 
that all packets have fixed size such that one packet can be 
transmitted in a single time slot. We use a schedule to denote 
the set of links that are allowed to transmit in a given time slot. 
A feasible schedule s = {si}i e x> is a _D-dimensional vector 
that satisfies the following properties: 

1) si G {0, 1} for all I G T>, where s; = 1 means that link 
I is scheduled to transmit in the current time slot, and 
si = otherwise. We assume that each link can transmit 
at most one packet per time slot. 

2) s must satisfy the interference constraints of the network. 
In other words, for any links G T>, and any feasible 
schedule s, if s/i = s/2 = 1, then links l-y and 1% can 
transmit simultaneously without interfering with each 
other. 

We denote the set of all feasible schedules by S. 

We assume that we do not do channel estimation before a 
packet is transmitted, and we denote by q the state of the 
channel in a given time slot at link I G T>, where q = 1 
means that the channel is ON and a packet transmission will 
be successful. Similarly, q = means that the channel is OFF. 
Assume that for all links, q is a Bernoulli random variable 
with mean q > 0, that is independent across time slots, and we 
only get to know its actual value after attempting transmission. 
Denote by c = {q}/eu the vector of channel states at a given 
time slot. 

It must be noted that depending on the schedule and 
transmission parameters^ that we use, link reliability may 
vary. For example, if you schedule only one link at any time, 
link reliability may be higher than trying to simultaneously 
schedule as many links as possible. Thus, we could extend 
the concept of the channel state to allow for the possibility 
that q could vary depending on the schedule or transmission 
parameters used, but this channel model, albeit more realistic, 

'E.g., modulation, power level, coding, etc. 



does not give us more insight into our problem. Hence, for ease 
of explanation, we will only consider in this paper a simple 
channel model. 

The admission control problem that we are studying is the 
following: assuming that a subset C C T> can been served 
with mean flow rate x, and that link I G T> \ C requests 
to be admitted with flow rate x, can we determine, without 
knowledge of the capacity region and without disturbing the 
service rates in the set C, if link I can be served? 

IV. Optimization Framework 

Now, we formally present the utility maximization frame- 
work that we will use later to develop a suitable admission 
controller. To do that, we consider the problem when we only 
need to serve a given subset of links. 

Consider a subset C C V of links that will be served. Let 
L = \C\ be the number of links on the set. Without loss of 
generality, assume that links are numbered 1 through L, and 
as mentioned before for the set T>, we sometimes use I G C 
to mean I £ {1,2, ... , L}. 

For this case, we limit the set of feasible schedules to those 
such that si = for alH G V \ C; that is, the set of feasible 
schedules that only serve links in C. We denote the restricted 
set of feasible schedules by S(C) C S. A scheduling policy 
over C is defined as a probability function Pc (s) that indicates 
the probability of using schedule s G S in a given time slot, 
such that 

P c (s) > for s G S(C), 
P c (s) = for all s G S \ S(£), and 

sGS 

Observe that, from the definition of Pjr(s), we have 

]TP £ (s)= £ Pc(s) = l. 
ses ses(c) 

Noting that a transmission can only be successful if the 
channel is ON, i.e. q = 1, we have that qs/ denotes the 
number of successful transmission attempts at link I in a given 
time slot. We assume that we can schedule a transmission even 
if there are no packets available, in which case a null packet is 
transmitted. Therefore, the average service rate to link I G T> 
is bounded by 

1 

Mi < J2 ^lP{ci)Pc{s), (1) 

where (HJ makes explicit the fact that the distribution of q is 
independent on the schedule s. It should be noted from the 
definition of Pc{s) that /i/ = for alH G V \ C. Simplifying 
(Q]l we get 

IH < c/s ; P £ (s). (2) 

ses(c) 

Observe that if in a given time slot we use schedule s, then 
on average we will have qs; successful transmissions at link 
I. 
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Definition 1: The set of average successful transmis- 
sions at any time slot is the set of vectors {ciSi}i^t> where 
s G S(C). o 

Definition 2: The capacity region C(C), restricted to the set 
L, is the set of average service rates /i = {fJ,i}iev such that 
there exists a scheduling policy -Pc(s) and (0 holds true for 
all leV. o 

From Definitions Q] and [2] we observe that C(£) is the 
convex hull of T(C). 

Associated with every link, we define a utility function 
Ui{xi), that is a function of the mean assigned flow rate X[. By 
properly choosing a suitable utility function, it can be seen that 
the following optimization problem can have different resource 
allocation solutions: 



max y^Ui(xi) (3) 



subject to 



< xi < hi for alH G C 
xi =0 for all / G V \ C. 

We will denote by (/z*,x*) a solution to (01. Note that the 
solution may not be unique, but the optimal value is. In Section 
|V1 we will introduce a utility function that will allow us to 
allocate resources such that we can solve the admission control 
problem. 

V. The Admission Control Problem 

To solve this problem, we first present a scheduler and 
resource allocator in Section IV-A1 and in Section IV-BI we 
prove the convergence results that guarantee that the stochastic 
system is stable and that resources are assigned according 
to the utility functions that we define for each link. Later 
in Section IV-CI we introduce a suitable utility function and 
prove that it forces the resource allocator to guarantee a mean 
assigned rate of x to all links in C, while at the same time it 
accurately estimates the maximum available rate for the new 
link, allowing us to make an admission control decision. 

A. Scheduler and Resource Allocator 

Using a dual decomposition approach similar to the one 
used in lETI . we propose the following scheduler for serving 
the set of links C at time slot t 



(4) 



s(t) G arg max^ qi{t)ciSi 
seS(£) ig£ 

and the distributed resource allocatoi@ at link I G C 



xi{t) G argmax -Ui{x{) - qi(t)xi, (5) 

0<x,<X max £ 

2 Note that on the literature it is also known as congestion controller. Later 
we will prove that it allocates resources to links depending on the specified 
utility functions. Thus, in this paper we will prefer the term resource allocator 
to make clear the fact that later we will choose the utility functions to force 
the system to allocate resources such that we can make an admission control 
decision. 



where e > is a fixed-size parameter, X max > is a 
large enough parameter, and q(i) = {qi(t)}i e c are the queue 
lengths at every link. We need to convert x(i) = {xi(t)}i^c, 
which may not necessarily be an integer, into the number of 
packets that are admitted into the network at time slot t, which 
we denote by a(t). To do the conversion, which can be done 
in many different ways, we specify that ai(t) is a random 
variable with mean xi(t) and finite variance upper-bounded 
by a 2 , such that P(ai(t) = 0) > and P(ai(t) = 1) > 0. 
The last two conditions guarantee that the Markov chain q(t) 
is irreducible and aperiodic. 
Denoting by 

di(t) = ci(t)si(t) (6) 

the number of successfully transmitted packets at link / in time 
slot t, we note that q(t) is updated with the equations 

q t (t + 1) = [©(*) + ai(t) - di(t)] + 
for all I G C, where for any a 6 M, a + — max{a, 0}. 

B. Convergence Analysis 

We now proceed to present the convergence results that 
prove that and (01 keep the queues stable and that allocate 
resources optimally. 

Lemma 1: Assume that X max > 

max^cjx) {maxi & c{w}}- If there exists /i(A) G 
C(£)/(l + A) for some A > such that /i,(A) > 
for all I G C, then 



lim E 



iec 



«(*) 



<B 3 + -B 4 
e 



given e > and for some B3 > 0, B4 > 0. o 
The proof can be found in Appendix [A] Lemma Q] tells us 

that, if there exists a resource allocation vector such that we 

can serve all the links with a non-zero mean rate, then our 

algorithm can stabilize the queues. 

Lemma 2: Given e > 0, and assuming that Ui( ) is a 

concave function, we have that 



lim 



' iec 



T 



*=i 



<B x e, (7) 



for some B\ > 0, where x* a solution to (0 and x(i) is a 
solution to ©. o 

In Appendix [B] the proof can be found. Lemma [2] tells us 
that our algorithm is asymptotically optimal. 

The proofs in Lemmas Q] and |2] follow the techniques in 
ll2D . which are similar to the ideas in [22]. Slightly different 
results can be derived using the methods in 



C. Solution to the Admission Control Problem 

So far, in Section |IV] we presented a model to serve a 
subset C C T> of links that allowed us in Section IV-AI to 
develop a suitable scheduler and resource allocator. We will 
now consider the following problem: given that all the links 
in the set C can be served with an assigned flow rate x, and 
that link I G T> \ L requests to be admitted with flow rate x, 
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can we determine, without knowledge of the capacity region 
and without disturbing the service rates of the links in the set 
C, if link I can be served? 

To do that, we will first introduce the notation C + to denote 
the set formed by the set of links in C and the link that wants to 
be admitted. Thus, we have that \C + 1 = L + 1, and by abusing 
notation we will write I G C + to mean I G {1, 2, . . . , L, L+l}, 
where the index L + 1 is assigned to the new link. 

We will prove that by using the following utility function 
Ui(xi) at link I G C+ 



Ui{xi) 



uixi if xi < x 
uix if xi > x, 



where ui > is a suitable constant, we can achieve the desired 
goal. Note that the utility function increases with xi up to x, 
and after that there is no gain in increasing the flow rate. Also, 
note that to completely define the utility function we only need 
to specify the utility parameter ui since x is fixed. 
The analysis will assume that 



Ui(xi) 



uxi if xi < x 
ux if xi > x 



for all / G C 



(8) 



and 



UAxi) = \ UnX ! l l Xl z X for I = L + l, (9) 

v ; \ U n X if Xl > x ' w 

and we will compare (01 and the optimization problem 

Ui(xi) (10) 



max 

MeC(£+),x ^— ' 

ze£+ 



subject to 



< xi < m for all I G C + 
xi=0 for all leV\C + , 



to find the conditions on u and u n such that we can make 
an admission control decision. We will call the optimization 
problem (0 over the set C the old system, and the optimization 
(TlOl l over the set C + the new system. 

Theorem 1: If the utility functions are given by (0, (0, and 
assuming the old system (0 can assign a flow rate of x to all 
links in C, and if 

u» < u min {c{\ /c L +i, 
iec+ 

then the new system ( TTOb will assign a flow rate of x to all 
I G C and a rate x < x to link L + l, where x is the maximum 
rate that can be assigned to link L + l that allows to assign x 
to all other links. o 
Proof: If there exists [i G C(C + ) such that /ii = x for 
all I G C + , we are done since (/j*,x*) = (n, {x}i e c+) is a 
solution to the problem of the new system (I lot . Thus, we will 
assume that link L + l interferes with the set I G C such that 
if > x, then some link in I must get an assigned flow 

rate strictly less than x. Without loss of generality, we will 
proceed to do the analysis for link L assuming that it is in I. 
Define the scheduling policy P^ + (s) such that = 



= £ s 



eS(£+) ° 



c l +iSl+iPc+{s) and x\ = 



Sse5(£+) ci s iPc+ ( s ) f° r ai l I € A where x < x is the 
maximum rate that can be assigned to link L + l that allows 
to assign x to all other links in I. 

Now consider schedules s^s 2 G S(C + ) such that 



0, s 



i 

L+l 



1. We 



P^s 1 ) > 0, s L = 1, s L+1 = 0, sj 

know that they exist since link L is in I and from the definition 



of x. For small enough <5 > 0, define the policy P? + (s) as 



follows 



J>| + (s) = 



P^+(s) fors^s 1 ^ 2 
P^+ (s) - S for s = s 1 
Pl+{s) + 5 fors = s 2 . 



In this case, from the definition of I and since xf = 
Eses(£+) czS;P£ + (s) for all I G C + , we have the following 
rate allocation 



Sc L 
Scl+i 



if I = L 
if I = L 



1. 



Comparing the objective function for both policies we have 



> 



ux + u n x 



lec 



L-l 



ux + u (x — Scl) + u n (x + 5cl+i) 

.1=1 

= uSc L - u n ScL+i 

> u8 min {c;i — u n ScL+i 



S u min {q} - u n c L+1 



Since the analysis is valid for any link in I, if u n < 
itmin; e £+ {ci} /cl+i, then it is optimal to allocate a rate of 
x to all links in L and x to link L + l, which proves the 
theorem. ■ 

It is interesting to note that Theorem [TJ gives us the condi- 
tions such that the resource allocator (|5) can be used to test 
if there are enough resources to fulfill an admission request 
without disturbing other links. Since the analysis was done for 
a static optimization problem, we will now use Lemma [2] to 
show how the choice of u and u n influence the mean assigned 
rate over the actual network problem, which is dynamic and 
stochastic in nature. 

Theorem 2: If the utility functions are given by ((HJ, (O, and 
assuming the old system (0 can assign a flow rate of x to all 
links in C, and if 



u n < u min {q} /cl+i, 
iec+ 



then for I G C 



lim E 



1 



u u 



5 



and for I = L + 1 



lim E 

T^oo 



1 

f2Z x L+l{t) 



> X 



B 6 e 



(12) 



for some Bq > 0, where x(t) is a solution to (0, and x < x 
is the maximum rate that can be assigned to link L + 1 that 
allows to assign x to all other links. o 
Proof: Before we proceed, if the utility functions are 
given by (© and ©, we note that (0 can be rewritten for 
all I G C + as 

xj(t) S argmaxi?7/(.T/) - qi{t)xi. 

o<xi<x e 

Thus, for all £ we have that a?;(t) < 5. Also, Theorem Q] tells 
us that x* = /j* = where (/i*,x*) is a solution 

to ([[Oil- 
Note that Lemma [2] is valid for any C G £>, so it is also 
valid for C + . Thus, rewriting (O for C + , and using ||8}, ||9), 
TheoremQ] and the fact that for all t and I, xi(t) < x, we get 



iec+ 



1 T 



lim I < ra- iti? 



1 T 



*=i j / 



where _Bg > is a constant that is similarly found as B\ for 
the case that Lemma |2] is rewritten for the set C + , and where 
we define 

1 T 



if = lim E 1 

T->oo 



for all Z G £ + . 



Hence, we get the following inequality 

uxL + u n x - u n x L+ i - u J^x^Bee. (13) 



lec 



Consider link L + 1. Since xi{t) < x for all t and / G £ H 
note that xi < x. Then 

B 6 e 



Xl+i > — xL + i: 



E 



> st 



Bae 



Now consider link I G C. From the fact that xi < x, we have 
that 

Bee 
u 



xi > xL — y Xi H a; ^l+i 

i£C\{l} 



_ B 6 e u n 

> a; (£ — x), 

u u 



which completes the proof. ■ 
Theorem [2] gives us a lower bound on the mean assigned 
rates, assuming that only one link will be responsible for the 
loss in performance of the stochastic system compared to the 
static optimization problem. For fixed e, equation (fTTT i suggests 
that u should be large to guarantee that the links in the set 
C get a mean assigned rate close to x. Although ( fT2l also 
suggests that u n should be large to make sure we accurately 
determine the maximum mean rate that we can assign to link 
L + 1, if our goal is to disturb the mean assigned rates for 
links in C as little as possible, the ratio u n /u should be as 
small as possible, as we highlight in the following corollary. 

Corollary 1: If the utility functions are given by (©, (0, 
and assuming the old system ([3]) can assign a flow rate of x 
to all links in C, and if 



u n < u min {q} /c l+1 , 



then 

xL — y lim E 
^ r->oo 



1 T 



Bq€ U n 

< 1 {xl+i - x) 

u u 



lec 

for some B$ > 0. o 
Proof: We get the desired result by rewriting (TTJi . ■ 

VI. Capacity Region 

To design a suitable admission controller, we must prove 
that we have properly defined the capacity region. Hence, in 
Lemma [3] we will first show that if we allocate mean rates 
that are not in the capacity region, then there is no scheduling 
algorithm that can keep the queues stable. Second, in Lemma 
|4] we will show that if we allocate rates that are an interior 
point of the capacity region, there is an algorithm that can 
keep the queues stable. 

Lemma 3: If x ^ C(C), then no scheduling algorithm can 
keep the queues stable when the mean assigned flow rates are 
given by x. o 

The proof can be found in Appendix O and follows a 
technique similar to [25|. 

Lemma 4: If x G C(£)/(l + A) for some A > such that 
xi > for all I G C, then there exists a scheduler that keeps 
the queues stable when the mean assigned flow rates are x. o 

In Appendix|D]the proof is presented. It follows a technique 
similar to the ideas presented in [22]. 

VII. Conclusions 

We have considered the problem of distributed admission 
control without knowledge of the capacity region in single-hop 
wireless networks for flows that require a pre-specified band- 
width from the network. To achieve this goal, we presented 
a utility maximization framework that allowed us to develop 
a scheduler and a distributed resource allocator. By properly 
choosing the utility function used by the resource allocator, 
we have proved that existing flows can be served with a pre- 
specified bandwidth, while the link requesting admission can 
determine the largest mean flow rate that can be assigned that 
avoids interfering with the service to other nodes. 
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Appendix A 
Proof of LemmaQ] 

We will start by first proving some auxiliary lemmas. 
Lemma 5: The following optimization problems have the 
same solution 



max qi(t)cisi — max qi(t) 



sES(C) 



lec 



fj.ec(c) 



//,. 



EC 



Proof: From Definition Q] we know that the following two 
optimization problems are equivalent 

max > qt(t)crsi = max > qi(t)ji- 
v lec lec 
Since the objective function is linear, the optimal value will 
not change if we perform the optimization problem over the 
convex hull of T(£), which from Definition |2] we know that it 
is C(C). Thus, the following two optimization problems have 
the same solution 

lec 'lec 
which proves the lemma. ■ 
Lemma 6: Consider the Lyapunov function 
v ( c l) = \Hieclh and assume that X max > 
max (l g C(£ ) {max ;e£ {^}}. If there exists /i(A) G 
C(£)/(l + A) for some A > such that /i ; (A) > 
for all I <E £, then 

E[V(q(t + l))\q(t)=q]-V(q) 

< Bi - B 2 J2 9t - ^ E ( A )) _ Ul & w)i 

lec lec 

given e > 0, for some B 1 > 0, B 2 > 0, where C(£)/(l + A) 
is a scaled version of C(£), and x(i) is a solution to (O. o 
Proof: 



E[V(q(t + l))\q(t)=q]-V(q) 



E 



E 



< E 



E 



< E 



< E 



= E 



lec 



It,-; 



lec 



q(t) = q 

±J2{h + *i(t)-di(t)} + } 2 -\Y,H 

lec J lec 

5Z)[ffl+ai(*)-di(t)] 2 -^E«' 

£ 9 [a/ (f ) - dj (t)] + fa W " d ' 



lec 



lec 



X>[ai(i)-d,(t)] 

x;« [*(*)- * (*)] 

MO - QS;(t)] 



5J]B[^t)+^(t) 



Si 



(14) 



= £ 



^ --Ui{xi{t)) + qixi{t) + -Ui{xi{t)) - qicisi(t) 



lec 
B 1 



< E 



2{--^0*i(A)) + «w(A) 



.ze£ 



Si 



(15) 



= Bl + E \-~ u M A )) + -Ui{xi{t)) - «A W (A) 

= Bi-£>A W (A) - ±£[CM«(A)) -Hxi(t))] 
lec lec 

<B l -B 2 Y J U--Y,V Jl to (A)) - Ci fa (*))] 



lec 



lec 



where B\= L {X 2 lax + a 2 + l) /2, (fl4] > is a consequence of 
© and the definition of /x; (t) in ((TJ and (|2), ([T5T > follows from 
©, ©, Lemma|5] and the fact that (1 + A)/i(A) e C(£), and 
B 2 = Amin/ e£ { W (A)}. ■ 
Since the last term in the right-hand side of the inequality 
can be upper-bounded, we have that the expected drift is 
negative but for a finite set of values of q(t), and therefore 
the Markov chain q(£) is positive recurrent. As a consequence 
of this fact we can now prove Lemma Q] 

Proof of Lemma Q} 

E[V(q(t + l))\q(t)=q]-V(q) 

< B 1 - B 2 ]T qi + -J2 [Ui (xi (t) ) - Ui (fit (A))] 
lec lec 



< Bl -B 2 ^2q l + ~J2 [\ U M))\ + I^(W(A))|] 
lec lec 



e e -~ t o<x,<x„ 
lec lec ~ ~ 



This expected drift is conditioned on the event {q(t) = q}, 
so averaging over possible values of q(t) we get 



E[V(q(t + l))]-E[V(q(t))} 



<Bi- B 2 E 



£«(*) 



Liec 



-V2 max \Ui(x t )\ 
lec 



Since the Markov chain q(t) is positive recurrent we know 
that for any initial distribution of q(l) the distribution when 
t — > oo is unique and equal to the equilibrium probability 
distribution. Thus 



< Bi-B 2 lim E 

t— >oo 



£*(*) 



Liec 



max Ui (xi ) 
e ^ o<x,<x ma!C 
lec 
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Reordering terms we get 



lim E 

t— >oo 



E«(*) 



.lec 



< 



Bi 1 Y,iec 2max o<a; 1 <x max \Ui(xi) 



B 2 
B 3 - 



Appendix B 
Proof of Lemma|2] 

To prove that our scheduler and resource allocator optimally 
solve the stochastic network problem, we will use a slightly 
weaker version of Lemma [6] 

Lemma 7: Consider the Lyapunov function 
V(q) = \Y,ieclh and assume that X max > 
max^ecfr) {max ;e£ {^}}. Then 

£[f(q(* + l))|q(*)=q]-V(q) 

< Bi - b 5 y,u - -E tw) - 



given e > 0, for some i?i > 0, B§ > 0, where x* a solution 
to (O, and x(t) is a solution to (O. o 
The proof is almost identical to the proof for Lemma [6] which 
can be found in Appendix lAl and it is therefore omitted. 

Proof of Lemma [2} Rearranging terms in Lemma [7] we 

get 

~E^*)-^M*))] 

lec 

< B x - B B X> ~ -E [V(q(t + l))|q(i) = q] + 7(q) 



< Bi — E [V(d(t + l))|q(i) = q] + V(q). 

This inequality is conditioned on the event {q(i) = q}, so 
averaging over possible values of q(i) we obtain 



l -E 

e 



Use 



<B 1 -E[V(q(t+l))] + E[V(f l (t))]. 

Adding terms from time slots 1 to T and dividing both sides 
of the inequality by T we get 



1 



-E 



Jec { t=i J . 



< Si - ±E [V(q(T + 1))] + Ie [V(q(l))] 

<i?i + ^£;[y(q(i))], 



(16) 



where ([T6l l follows from the fact that the Lyapunov function is 
non-negative. Taking the limit as T — > oo and assuming that 



E [V{q[l))\ < oo we obtain 



lim E 

LleC K 

ReaiTanging terms 



t=i 



< Bie. 



lim Ei 



T^oo 



< -Bie. 



Finally, using Jensen's inequality B26I1 and the fact that Ui(-) 
is a concave function, we have 



to E| W) -£M 15 



1 T 

rE^*) 



^ T to X|W- £ 



~E £/,(*,(<)) 



< -Bie. 



Appendix C 
Proof of Lemma[3] 

The proof is based on the Strict Separating Hyperplane 
Theorem [27, Appendix B.3], which says that since C(C) is a 
convex set and if x ^ C(C), then there exists a vector b such 
that 



b T x > max b T z + B 

zeC(£) 



for some B > 0. We can let b = x — xq, where 



xo = arg mm |x — z 

zec(c) 



(17) 



(18) 



First, we highlight that b is a non-negative vector. To see 
this, assume that there exists I e L such that bj = x^—x^ < 0. 
Defining the vector x' such that x[ = xqi for I £ C \ {1} and 
x~ = xj, we note that x' G C(C) and it can be checked that 

x — x'| < x — Xo|, 

which contradicts ( fT8l . Second, since x ^ C(C) we note that 
b must have at least a positive element. 

Now let us consider the arrival process ai(t) such that 
E[ai(t)} — xi for all time slots t and all I e C, and consider 
that arrivals are independent of the queue lengths. Defining 
the function 

V(q) = b T q 



s 



we have the following drift analysis 
E[V(q(t + l))\q(t)=q]-V(q) 



E 



E 



> E 



E 



+ q(t)=q 

lec 

53 6, {ft + ai{t) - di(t)} 
lec 

53 6 ; {ft + ai(t) - di(t)} 



- 53 b M 

lec 

q(t) = q 

q(t) = 



(e£ 



ie£ 



53 

ie£ 



q(t) 



5>{a,(t) -</,(<)} 

lec 

53 6, {x,-£;[c I (t)fi,(t)|q(t)=q]} 
ie£ 

53 {z; - /ij(f)} 



(19) 



ie£ 

= b T x - b T ,u(f) 

> b T x — max b T z 

zec(£) 



(20) 
(21) 

where (fT9l l uses ©, (|20] > follows from Definition [2] where it 
can be checked that fi(t) G C(C), and (fJTJ follows from dT7f . 
But this implies that lim^oc E [V(q(t))} = 00, which proves 
that the system is not stable in the mean. ■ 

Appendix D 
Proof of Lemma|4] 

Consider the Bernoulli arrival process aj(t) such that 
E[ai(t)} = xi < X, variance upper-bounded by a 2 , P(ai{t) = 
0) > and P{ai(t) = 1) > for all time slots t and all 
I G £0 Furthermore, consider that the arrivals are independent 
between time slots. 

Define the scheduling policy Pc (s) such that 

(1 + A)a:,= ^ s i p d s ) (22) 

ses(c) 

for all I G C. From Definition [2] we know that such policy 
exists since (1 + A)x G C(C) because x G C(£)/(l + A). 

If we use the Lyapunov function V(q) = \ J2iec Ql> tnen 
we have the following drift analysis 



E[V(q(t + l))\q(t)=q]-V(q) 



= E 



E 



< E 



5 



L ^ H c 



lec 



q(0 = q 

i^r{fe + ai (t)-^)] + } 2 -W<i 

lec J lec 



ie£ 



lec 



3 The last two conditions guarantee that the Markov chain q(t) is irreducible 
and aperiodic and can be replaced by similar assumptions. 



E 



< E 



< E 



E 



2 g ; [a t (t) - d ; (<)] + ~ J2 [01 (*) ~ * (*)] S 



L;g£ 



;g£ 



5]ft [01(f)- di(t) 
;e£ 

53 © [ai(t)-di(t) 
lec 

53© [ ai ^) ~ 5 ' s i(*)] 



i53£[a?(f)+d?(f)] 



ie£ 



L/G£ 



53 ft [ai - (1 + AJarj] + Pi 
lec 

Pi 



(23) 
(24) 



Ay3ftx; 

;e£ 

</3i-/? 2 53ft 



;e£ 



where fix = L (X 2 + a 2 + l) /2, 



is a consequence of 



©, (124-b follows from (|22T >. and ^2 = Amin; g £ {^i}- 

Since 02 > because x; > for all Z G C, we have that 
the expected drift is negative but for a finite set of values 
of q(f), thus the Markov chain q(f) is positive recurrent. A 
consequence of this is that the expected queue lengths are 
finite, which concludes the proof. ■ 
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